Bayesian active learning with abstention feedbacks
نویسندگان
چکیده
We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling queried example some unknown rate. This is an important problem many useful applications. take Bayesian approach to the and develop two new greedy algorithms that learn both classification rate at same time. These are achieved by simply incorporating estimated average into criteria. prove have near-optimality guarantees: they respectively achieve (1-1e) constant factor approximation of optimal expected or worst-case value utility function. Our experiments show perform well in various practical scenarios.
منابع مشابه
Bayesian Pool-based Active Learning with Abstention Feedbacks
We study pool-based active learning with abstention feedbacks, where a labeler can abstain from labeling a queried example. We take a Bayesian approach to the problem and propose a general framework that learns both the target classification problem and the unknown abstention pattern at the same time. As specific instances of the framework, we develop two useful greedy algorithms with theoretic...
متن کاملPsychophysical Detection Testing with Bayesian Active Learning
Psychophysical detection tests are ubiquitous in the study of human sensation and the diagnosis and treatment of virtually all sensory impairments. In many of these settings, the goal is to recover, from a series of binary observations from a human subject, the latent function that describes the discriminability of a sensory stimulus over some relevant domain. The auditory detection test, for e...
متن کاملDeep Bayesian Active Learning with Image Data
Even though active learning forms an important pillar of machine learning, deep learning tools are not prevalent within it. Deep learning poses several difficulties when used in an active learning setting. First, we have to handle small amounts of data. Recent advances in deep learning, on the other hand, are notorious for their dependence on large amounts of data. Second, many acquisition func...
متن کاملBayesian Active Distance Metric Learning
Distance metric learning is an important component for many tasks, such as statistical classification and content-based image retrieval. Existing approaches for learning distance metrics from pairwise constraints typically suffer from two major problems. First, most algorithms only offer point estimation of the distance metric and can therefore be unreliable when the number of training examples...
متن کاملStructured Output Learning with Abstention: Application to Accurate Opinion Prediction
Motivated by Supervised Opinion Analysis, we propose a novel framework devoted to Structured Output Learning with Abstention (SOLA). The structure prediction model is able to abstain from predicting some labels in the structured output at a cost chosen by the user in a flexible way. For that purpose, we decompose the problem into the learning of a pair of predictors, one devoted to structured a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2022
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2021.11.027